On Semantic Cognition, Inductive Generalization, and Language Models

نویسندگان

چکیده

My doctoral research focuses on understanding semantic knowledge in neural network models trained solely to predict natural language (referred as models, or LMs), by drawing insights from the study of concepts and categories grounded cognitive science. I propose a framework inspired 'inductive reasoning,' phenomenon that sheds light how humans utilize background make inductive leaps generalize new pieces information about their properties. Drawing experiments reasoning, analyze generalization LMs using phenomena observed human-induction literature, investigate behavior tasks such implicit reasoning emergent feature recognition, relate induction dynamics learned conceptual representation space.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Bayesian Models of Inductive Generalization

We argue that human inductive generalization is best explained in a Bayesian framework, rather than by traditional models based on similarity computations. We go beyond previous work on Bayesian concept learning by introducing an unsupervised method for constructing flexible hypothesis spaces, and we propose a version of the Bayesian Occam’s razor that trades off priors and likelihoods to preve...

متن کامل

Language Networks as Models of Cognition: Understanding Cognition through Language

Language is inherently cognitive and distinctly human. Separating languageas-object from the human mind that processes and creates language fails to capture the full language system. Linguistics traditionally has focused on the study of language as a static representation, removed from the human mind. Network analysis has traditionally been focused on the properties and structure that emerge fr...

متن کامل

Social Cognition of Gender and Language

The question, Do men and women use language differently played a central part in the emergence of feminist socio linguistics more than two decades ago, and it casts a long shadow. This paper focuses on the literature that has contributed to the understanding of the major research questions underlying two major strands, language and gender, concentrating on the development of the literature from...

متن کامل

Probabilistic models of cognition: exploring representations and inductive biases.

Cognitive science aims to reverse-engineer the mind, and many of the engineering challenges the mind faces involve induction. The probabilistic approach to modeling cognition begins by identifying ideal solutions to these inductive problems. Mental processes are then modeled using algorithms for approximating these solutions, and neural processes are viewed as mechanisms for implementing these ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence

سال: 2022

ISSN: ['2159-5399', '2374-3468']

DOI: https://doi.org/10.1609/aaai.v36i11.21584